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If all ptxels are within a specified threshold, the output toaxi 
is the average of the four pixels, two on each side of 
ine target. 
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If the two pixels 100% 
on either side of 
the target pixel 
and the target 
pixel itself are 
within a specified 0% 
threshold, the 
target pixel is 
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.Output 
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considered to be an edge pixel. The output is the average of the two pixels on the matching 
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.Output 
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If the five pixels 100% 
are all increasing 
or decreasing (or 
are within a 
small threshold 
to account for 
ringing or pre- 
emphasis 

typically found in analog video signals), the target is considered to be in the midst of a 
blurred edge. The output is the average of the two pixels on whichever side is closest to the 
target pixel. 
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If the five pixels in the window do not fit into any of the 100 % 
prior cases, the target is considered to be in the midst 
of a busy area. The target pixel is output unchanged. 
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PRE-FILTER 



Thresholds set by application: 
Te <r Edge Threshold' 
To <r Uniform Threshold « 
To <r Overshoot Threshold" 



/NexT\ 



Row <rQ 



Next 



B <r C <- O <r Pixel (Row.O) 
dBC <- <tCO dD6 <- 0 
E <rFbOBH (Row t 1) 
Cp<<-0 



i: £, 



A B. B <-C, C <- D, O <r E 
dAB «• dBC, dBC <-dCO 
dCO^dOE 




TYPICAL VALUES ARE: 
3 FOR OVERSHOOT, 
8 FOR UNIFORM, AND 
20 FOR EDGE 

START OF IMAGE 



START OF ROW 



START OF PIXEL 



■ Yea » 



E Pixel (Row, Col+2) 



dOE«0 A E 
d8D * B A> O 
aAB * Avg (A,8) 
aOE * Avg (0«E) 




J*Q> 



*3 



Output Pixel 
Avg (aAB. aOE) 



GET NEW PIXELS UNTIL RIGHT 
EDGE OF IMAGE IS REACHED, . 
THEN LET OLD "E" VALUE 
PROPAGATE TO "D" AND "C" 

A IS THE SQUARE OF THE DISTANCE BETWEEN 
TWO COLORS IN 3-D YC SPACE WITH DOUBLE 
WEIGHT GIVEN TO Y. THE THRESHOLDS WERE 
SQUARED, ELIMINATING THE NEED TO TAKE THE 
SQUARE ROOT IN THIS STEP. 

IF BOTH PIXELS ON EITHER SIDE OF THE TARGET 
ARE UNIFORM (dAB, dDE) AND THE TWO SIDES 
ARE UNIFORM (dBD), THEN THE TARGET IS EITHER 
UNIFORM (IF IT IS ALSO SIMILAR) OR IMPULSE 
NOISE (IF IT DIFFERS). REPLACE THE TARGET 
PIXEL WITH THE. AVERAGE OF THE SURROUNDING 
PIXELS IN EITHER CASE. 



FIG. 7 7 A 



- • -' - • 

Title: SmarTCard For Storage and Retrieval of Digitally Compressed Colorlmages 
Inventor: Anthony H. Otto 
08/836,116 



6/28 




If all pixels are either increasing 
or decreasing in luminance, a 
gradient or sfow (blurred) edge 
has been detected. 

Notef. 

The overshoot threshold is 
used to compensate for 
preemphasis in the analog 
signal. The comparison is 
actually: 

Ay < By or dAS < To 
Note 2. 

Comparison 6y only the 
...luminance components 
has been shown here: 
if computational power 
is available, a more 
compfete solution would 
be to check that all three 
components were either 
decreasing or increasing. 

Output the average of the 
two pixels to whichever 
side Is closest to the target 
pixei provided those two 
pixels are sufficiently dose 
to each other so as to not 
distort the image. 
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Output pixel 
Avg (C ( aAB) 

T 



If the target pixel and both pixels to the left 
are within the edge threshold, a fast edge to 
the right of the target Is detected. The Output 
is the average of the target pixel with the two 
pixels to. the left, further sharpening the edge. 



End 
Col 



dCD < Te 

and 
dDE < Te 



Yis 



-No >i 



Output pixel 
Avg (C, aDE) 




If the target pixel and tooth pixels to the right 
are within the edge threshold, a fast edge to 
the left of the target is detected. The output 
is the average of the target pjxei with the two 
pixels to the right, further sharpening the edge. 
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THE TARGET PIXEL HAS NOT FALLEN 
INTO ANY OF THE CASES, SO IT IS 
OUTPUT UNCHANGED. 
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f BASIC 
ENCODE 



Collect 4X<Wock of 
YCrCfa pixels Into 
16 element buffer 



Buffer index will range from 0 to 15. * 
Color components will be referred to 
as: -V\ -.Cr". and \Cb" 



i<-0 
Y<-Cr«£<-0 
Y2<-Cr2<-Cb2<-0 



Y^Y + Bufferffl/Y 

V2 <r Y2 + Squarepuffertil.Y) 

Cr<-Cr+Bufrer{fJ.Cr 

Cr2 «• Cr2 + Square £uffer{Il.Cr! 

Cb Cb + BuffertlJ.Cfc 

Cb2 Cb2 + SquareftuffertQ.Cb) 




Step 1 - Collect first and second moments 



Accumulate separate component values as 
squares for each pteeL Squares are calculated 
by tabte lookup rather than by muttiplfcation. 




dY * Root (Y2 / 16 - Squarrt2(Y) / 256) 
dCr * Root (Cr2 M6 - Square12(Cr) / 256) 
dCb tz Root (Gb2 / 16 • Squarel2(Cb) / 25G) 



3. 



mY«Y/16 

mCb«Cb/16 

mCr«Cr/16 



The 6quarel2 function calculates the square of 
a 12-bft number using the same 6-bft taWe of 
squares above and&tte extra arithmetic. The 
root function finds roots by binary search of the 
6-bit table of squares. 

dY. dCr, and dCb are the standard deviatfon#^Jfr 
each component and mY, mCr, and mCb areffar ; 
arithmetic meant 
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9 



l=0 
$Cr«0 
Map «=o 
sCb*=o 



Shift map 
leftlbit 




SetLSSofmap 
*Cb<rsCb + (mCb . BurfafPI.Cb) 



-fee- 




der «--<iCr 



dCb«--dCb 



Step 3 - Deterrrrinp detector mar 



Use the mean luminance 
vafue for the selector. 



TTie one btts in the map mark those 
pixels that are "darker" than the 
mean. Accumulate the signed 
tfffemnces from the mean In each 
chromanance channel. 



If the Cr channel decreases when 
the luminance Increases, invert dCr. 



tf the Cfa channel decreases when 
the luminance Increases. Invert dCb. 
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Invert map 
dY <--dY 
dCr <r -dCr 
dCb <r -dCb 




>■ Yea ► 


dY <r 0 
dCr <r 0 
dCb <-0 









Map <-0 



Step 4 - Normalize 



If the luminance of all pixels is 
equal to (or, in practice, slightly 
greater than) the mean, zero all 
standard deviation values. 



If all of the pixels are nearly equal, 
the standard deviations will alt be 
zero. In this case the map is also 
zeroed. 



To reduce the number of possible 
maps from 65,536 to 32,768, if the 
map is set, the map is Inverted and 
the dY, dCr. and dCb values are 
negated. 



Output mY, mCr, mCb, 
dY, dCr, dCb, and map 



END BASIC 
ENCODE 



Typically 8 bits are used for each 
of the mY f mCr, mCb, dY, dCr, and 
dCb values aqd 16 bits are used 
for the map. 
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Class Codebook 



0=Escape 
1=Untforrn 
2=Uniform Chroma 
3=Pattem 
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COLLECT DATA FOR THIS BLOCK: 


• 


TYUNI 


UNIFORM LUMINANCE THRESHOLD 




TCUNI 


UNIFORM CHROMINANCE THRESHOLD 




T\/MI II 1 

1 YNULL 


-♦-NULL LUMINANCE THRESHOLD 




TCNULL 


^-NULL CHROMINANCE THRESHOLD 


! sat 


TMAP 


MAP ERROR THRESHOLD 


. LJi 


MAPGRP 


MAP GROUP PARAMETER 




BYPAT 


PA 1 1 bRN LUMINANCE BITS 
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BCPAT 


PATTERN CHROMINANCE BITS 
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UNIFORM LUMINANCE BITS 
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UNIFORM CHROMINANCE Bn*S 




mY 
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mCr _ 
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mCb 
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dY 


-♦-BLOCK STD. DEV. LUMINANCE 
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dCr 


BLOCK STD. DEV. Cr CHANNEL 




dCb 


BLOCK STD. DEV. Cb CHANNEL 




MAP 


BLOCK SELECTIQN MAP 



INITIALIZE VALUES: 
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IF MOST OF THE BITS IN MAP ARE ON 
OR OFF, SET TO ZERO MAP AND 
DEVIATION 




dY-«-dCr-«-dCI>«- MAP«- 0 



REDUCE mY TO 
REDUCE mCr TO 
REDUCE mCb TO 



BYUNI BITS 
BCUNI BITS 
BCUNI BITS 



REDUCE dY TO 
REDUCE dCr TO 
REDUCE dCb TO 



BYPAT BITS 
BCPAT BITS 
BCPAT BITS 





ADJUST dY, dCr, dCb BY 

V H 6-BIT C OUNT (NEW MAP)) / BIT COUNT (NEW MAP) 

| V (1 6-BIT COUNT (M AP)) / BIT COUNT (MAP) " 
M I — 
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ABS(mY) > TYNULL 
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OR ABS(mCb) >TCNULL? 




u NO 



mY**-mCr-< 

mCb 0 



CLASS 0 
(NULL) 



FIG. 14C 



!:>y 



ni^^^rd 




Title: SmarTCard For Storage and Retrieval of Digitally Compressed 
Inventor: Anthony H. Otto 
08/836,116 



13/28 



NO 



NULL C0UNT-<- 
NULL COUNT + 1 



CLASS n 
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EMIT CLASS 
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NULL COUNT -<- 0 
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EMfT CHROMA 
mCb 
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EMIT LUMINANCE 
mY 
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END COMPRESS BLOCK ^ 
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FIG. 16A 



D 


D 


D 


D 


D 


D 


D 


C 


B 


B 


C 


D 


D 


B 


A 


A 


B 


D 


D 


B 


A 


A 


B 


D 


D 


C 


B 


B 


C 


D 


D 


D 


D 


D 


D 


D 




FIG. 16B 



Title: SmarWard For Storage and Retrieval of Digitally Compressed Color Images 
Inventor: Anthony H. Otto 

08/836,116 <f 



24/28 




BIT CODE-*-! 1 000000000000000 B + MAP 
BIT CODE-LEN -«*-17 
MAP OUT^-MAP 




I 



RETURN BIT CODE, 
BITC0DE LEN, + MAP 
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BITSTREAM 
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I" 



Y <- Above. Y «- Below. Y + Left Y ♦ Right Y 
Cr <- Above.Cr + Below.Cr + LeftCr + Right Cr 
Cb <- Above.Cb + Betow.Cb + LeftCb * FUghtCt 



L'3 

hi 

V Hi 
I 5 | 



Yes 




Yes 



dAB <- abs(Above.Y - Below. Y) 
dUR c- abs(LaftY - RightY) 



Y<-(Y+Targ.Y x 4)/8 
Cr<-(Cr+Targ.Cr x 4)/8 
Cb<-(Cb+Targ.Cb x 4)/8 




Yes-* 



Y<-Y/4 
Cr<-Cr/4 
Cb<-Cb/4 



Tary.Y<-Y 
Targ.Cb <- Cb 



^ Next Pixel ^ 
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